MONOTONE TRIANGLES AND 312 PATTERN 

AVOIDANCE 



ARVIND AYYER, ROBERT CORI, 
AND DOMINIQUE GOUYOU-BEAUCHAMPS 

Abstract. We demonstrate a natural bijection between a sub- 
class of alternating sign matrices (ASMs) denned by a condition 
on the corresponding monotone triangle "which we call the gapless 
condition and a subclass of totally symmetric self-complementary 
plane partitions defined by a similar condition on the correspond- 
ing fundamental domains or Magog triangles. We prove that, when 
restricted to permutations, this class of ASMs reduces to 312- 
avoiding permutations. This leads us to generalize pattern avoid- 
ance on permutations to a family of words associated to ASMs, 
which we call Gog words. We translate the gapless condition on 
monotone trangles into a pattern avoidance- like condition on Gog 
words associated. We estimate the number of gapless monotone 
triangles using a bijection with p-branchings. 



Dedicated to Doron Zeilberger on the 
occasion of his sixtieth birthday 

1. Introduction 

The enumeration formula for ASM matrices was first proved by 
Doron Zeilberger |Zei96] by showing that monotone (or Gog) trian- 
gles naturally associated to them are equinumerous to Magog triangles 
associated to totally symmetric self-complementary plane partitions. 
Since the enumeration formula was known for these plane partitions 
this gave the result. The proof needed a long list of computations and 
since then, the construction of a bijection between Gog and Magog 
triangles has been and still is an open problem. We consider here a 
family of monotone triangles, which we call gapless, for which we show 
a simple bijection with a subclass of Magog triangles also satisfying a 
gapless condition. 

It turns out that among monotone triangles associated to permuta- 
tions, the gapless ones are exactly those correponding to permutation 
avoiding the pattern 312. This leads us to give a pattern avoidance-like 
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characterization for ASMs whose monotone triangles are gapless. For 
this purpose we introduce a family of words associated to monotone 
triangles and generalize to these words the notion of avoidance of the 
pattern 312. We note in passing that this notion of pattern avoidance 
for ASMs is different from that considered by Johansson and Linusson 
[JL07] . 

One of the main aims of this article is to build on the relationship be- 
tween alternating sign matrices and totally symmetric self- complemen- 
tary plane partitions first considered by Mills, Robbins and Rumsey 
[MRR82J. The other aim is to extend the notion of pattern-avoidance 
to other combinatorial structures related to permutations. One of the 
first works in this direction known to us is that of Hal Canary |Can08] 
who established a relation between tilings of an Aztec diamond and 
alternating sign matrices using Baxter permutations. 

The organisation of the paper is as follows. We first remind the 
reader of monotone (or Gog) triangles in Section [2j We then define 
the class of gapless monotone triangles for which we investigate their 
combinatorial structure and give an algorithm to build them in Sections 
[3] and HI We analyze a subset of these gapless triangles of rectangular 
shape in Section A natural simple bijection from gapless monotone 
triangles to gapless Magog triangles is then shown in Section |6j We 
next proceed to show the relationship between monotone triangles and 
312 patterns for permutations in Section [7J This will turn out to be 
the simple case for the main theorem about 312 subpatterns in Gog 
words, which we define in Section [HJ The proof of the pattern-avoidance 
theorem is then given in Section We summarize our results and 
give directions for future work in Section [TQJ We also give asymptotic 
estimates of the number of gapless monotone triangles in Appendix [A] 
and, for completeness, leading asymptotics of the number of alternating 
sign matrices in Appendix [Bj 



2. Monotone triangles 

Definition 1. A monotone triangle or strict Gelfand pattern or Gog 
triangle of size n is an array tc = (a^) of positive integers defined for 
n > i > j > 1 that is written in the form 



where, 
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(1) dij < ai,j < and a^j < Oi+ij+i whenever both sides 
are defined. That is to say, numbers increasing along rows, 
decreasing weakly along columns, and decreasing weakly along 
diagonals. 

(2) a nJ = j. 

We note that this is close to the original convention in [MRR83J 
for writing the triangles. However, it is different from the convention 
in |Zei96j . Monotone triangles are in natural bijection with alternat- 
ing sign matrices [MRR83] . Since permutation matrices are a class of 
ASMs, one can express each permutation as a monotone triangle. The 
way to do this is to write the ith row as an ascending list of the first i 
elements in the permutation. For example, the permutation 4312 can 
be written as 

4 

3 4 
13 4 
1 2 3 4, 

We now define a special subset of monotone triangles; those with a 
gap. 

Definition 2. A monotone triangle a contains a gap at position 

if dij — a i+ ij > 1. A gapless monotone triangle is a monotone triangle 

which contains no gaps. 

In the above example (I2.2p . the monotone triangle contains a gap at 
position (2,1). The monotone triangle corresponding to the identity 
permutation is an extreme example of a gapless one. The columnwise 
difference in that case is zero everywhere. 

In the definition of a monotone triangle, condition (1) consists in 
the satisfaction of three inequalities, notice that the third one can be 
omitted if the triangle is assumed to be gapless, since for integers the 
relation: 

a i,j < a i,j + l < a i+l,j + l + 1 

implies cijj < a i+ ij +1 . 
More precisely we have: 

Remark 1. A triangle (ay) of positive integers, (where n > i > j > 1) 
is a gapless monotone triangle if the following conditions are satisfied: 

(0) dij < di-xj < dij + 1 

(1) ' dij < dij + i 

(2) a nJ = j 



(2.2) 
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3. Shapes of gapless monotone triangles 

To any gapless monotone triangle (ajj) of size n we associate a shape, 
that is an array (sj j) of size n — \ containing entries and 1 and defined 
by 

s i,j = a i,j ~~ a i+l,ji 

for 1 < j < i < n. For instance the shape of 

3 

2 4 

(3.1) I I 4 

1 2 3 4, 

is 

1 

(3.2) 1 

111 

We remark that any triangle (sjj) with 0,1 entries is not necessarily 
the shape of a gapless monotone triangle. A simple characterisation can 
be given by examining the partial sums of two consecutive columns. 

To any triangle (sjj) of size n — 1 with 0,1 entries we associate 
n — 1 words f^ 2 \ ■ ■ ■ , f^ n ~ l \ on the alphabet {0, 1}, representing 
its columns. 

More precisely the word fk>) is of length j and given by: 

Sn—l,n—j ' ' ' Sn—j,n—j- 

Proposition 1. Two words g and h on the alphabet {0, 1} correspond 
to two consecutive columns in the shape of a gapless monotone triangle 
if and only their lengths \g\, \h\ satisfy \h\ — \g\ — 1 and for any i < \g\ 
we have 

i i 

(3.3) ^2gk>^2h k 

k=l k=l 

Moreover a sequence of words f^\ f^ 2 \ ■ ■ ■ f^ is the shape of a mono- 
tone gapless triangle if and only if for any k < n the words and 
y(fe+i) sa ti s fy th e condition given above for g and h. 

Proof. It suffices to remark that the Ojj of the corresponding monotone 
triangles are obtained from the by the relation 



a hj — J "T" /_, J k 



(n-j) 

J, 

k=l 
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so that the above inequality is a reformulation of the relation cijj < 

a i,j+l- D 

4. Growth processes for gapless shapes 

In the sequel gapless shape will mean shape of a gapless monotone 
triangle. That is a triangle with entries and 1 which columns 
satisfy the condition in Proposition [TJ 

4.1. Column insertion. A natural way to build a gapless shape is to 
proceed in giving the words f^ 2 \ ■ ■ ■ , f( n ' successively. The choice 
of possible depends only on the value of /( n_1 ). Moreover all the 
jf( n ) which may follow a given can be build by using a simple 

process which we describe below. 

For that purpose we consider some words on the alphabet {a, b}. We 
recall that a word w on this alphabet is a Dyck word if for any prefix 
w' of w the number of occurences of the letter a (denoted \w'\ a ) is not 
less than the number of occurrences of the letter b (denoted We 
now introduce a mapping associating to two words of length n — 1 
and n on the alphabet {0, 1} a word of length 2n — 1 on the alphabet 
{a, b}. 

We give first a mapping 9 giving for each pair of letters in {0, 1} a 
word of length 2 on the alphabet {a, b}: 

9(0,0) =ab, 0(M) = ba, 9(1,0) = aa, 9(0, 1) = bb. 

Considering two words g and h on the alphabet {0, 1} of lengths 
\h\ = \g\ + 1 = n we associate a word w = <p(g, h) of length In — 1 on 
the alphabet {a, b} given by 

w = ad(gi, hi)9(g 2 , h 2 ) ■ ■ ■ 9(g n -i, h n -i). 

For example, the word corresponding to the first two columns in the 
shape g = (1, 1) and h = (1, 0, 1), is 

w = 4>(g, h) = a9(l, 1)9(1, 0) = abaaa, 

which is a valid Dyck word. 

Proposition 2. Two words g and h of lengths n — 1 and n respectively 
correspond to two consecutive columns in a gapless shape if and only if 
the word w = <p(g, h), is a prefix of a Dyck word. 



Proof. The condition on the partials sums of g and h given in Propo- 
sition [T] translates naturally into counting the number of occurences of 
a and b in (p(g, h). □ 
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Corollary 1. The number of pairs of words g, h such that 

\h\ = \g\ + 1 = n 

and g and h represent consecutive columns in a gapless shape is equal 
to the central binomial coefficient 

'2n N 
n 

Proof. Using the well-known fact that the number of prefixes of Dyck 
words of length 2n — 1 is equal to the binomial coefficient ( 2 ™~ 1 ), and 
that the last letter of h may be or 1, we get 2( 2n ~ 1 ) = ( 2 ™). □ 

We used the column insertion construction to compute the number 
of all gapless shapes of monotone triangles up to size 12 obtaining the 
numbers below. For comparison, we also list the total number of ASMs. 



Size 


Number of ASMs in bijection 


Total number of ASMs 


1 


1 


1 


2 


2 


2 


3 


6 


7 


4 


26 


42 


5 


162 


429 


6 


1450 


7436 


7 


18626 


218348 


8 


343210 


10850216 


9 


9069306 


911835460 


10 


343611106 


129534272700 


11 


18662952122 


31095744852375 


12 


1453016097506 


12611311859677500 



Table 1. The number of ASMs in bijection and the 
total number of ASMs. 

5. Rectangular shapes 

Although it seems difficult to obtain a closed formula for the num- 
ber of triangular shapes, the number of rectangular ones have a nice 
enumeration formula. 

Definition 3. A gapless rectangular shape is a rectangular array r^j 
where 1 < i < p, 1 < j < m of 0's and 1 's such that for any j, i (where 
1 < j < m and 1 < i < p), 

p p 

(5.1) 
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To any rectangular shape can be associated a cumulant rectangular 
array Sy such that Sy = X}fc=i r fc,r Then the condition on r translates 
on s into 

Moreover since ry G {0, 1}, 

Sij+i — 1 < Sjj < p — i + 1. 

An example of a gapless rectangle and its cumulant array is given in 
Figure [TJ 



1 1 1 1 

1 1 1 1 

11110 11 

1 1 1 1 



1 1 1 3 3 3 3 3 
011122223 
1111112 2 
1 1 1 1 



Figure 1. A gapless rectangle and its cumulant array 

To any cumulant array is associated a triangular array tij such that 
tij is the smallest k such that s n +2-i-j,k > j if such k exists and equal 
to m + 1 otherwise. The triangular array associated to the cumulant 
array in Figure [1] is given by 

6 8 9 10 

< 5 - 2 > 2 5 8 

2 

It turns out that the triangular array built above belongs to a family 
of arrays called branchings and considered in |Gel 72j and in |CS75j . 

Definition 4. . A p-branching is a triangular array of po stive integers 
bij where 1 < % < p, l<j<p + l — % such that the entries are weakly 
increasing along rows and weakly decreasing along columns, 

The relation between gapless rectangular shapes, cumulant arrays 
and p-branchings may be summarized in the following statement. 

Proposition 3. The above construction is a bisection between gapless 
rectangles of size p, m and p-branchings with entries less or equal to 
m + 1. 

Recall that a semi-standard Young tableau is an array £y of entries 
weakly increasing along rows, strictly increasing along columns, that is 

ti,j < ti,j+l an d tij < tj+ij- 



s 
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Then the following proposition allows us to obtain an enumeration 
formula for gapless rectangles. 

Proposition 4. Let p,m be two integers not less than 1. There is 
a bisection between p-branchings with entries not greater than m and 
the set of semi-standard Young tableaux with entries in l,2,...p and 
having less than m columns. 

Proof. Consider the branching B = (bij), we build a semi-standard 
Young tableau T associated to it performing the following algorithm: 
For each i the i-the row of T has length hi — 1 where ki is the largest 
value appearing in the ith row of B. Then tij is equal to p + 1 minus 
the number of elements in the i-th row of B which are not less than 
j + l. The fact that T is indeed a semi-standard Young tableau follows 
from two simple remarks. The first one shows that tjj < ijj+i and the 
second shows that t^j < £j+ij. 

• Let u — «i, 1*2, • • • > u% be any sequence of integers and let a k be 
the number of elements in u not less than a given integer k then 

• Let u = Ui, u 2 , ■ • • Ui and v = v x, v 2 , ■ ■ ■ , be two non de- 
creasing sequences of integers such that for all j < i, Uj > Vj 
and let (resp. b k ) be the number of elements in u (resp. v) 
not less than a given integer k. Then > b^ for all k. 

Conversely given p, m and a semi-standard Young tableau T with 
entries not greater than p and having at most m columns we build the 
branching B by the process described below. 

For each i from 1 to p, the i-th row of B (which has length p+l—i) 
consists of ti t k — ti t k-i entries equal to k for each k > 1. If the length of 
the ith row of T is li, fill in p + 1 — entries equal to Z$ + 1. Since the 
ith row of B has to have length p + 1 — i, we fill the row with remaining 
entries equal to 1 and arrange the entries in non- decreasing order. 

□ 

To illustrate the above bijection we give the semi-standard Young 
tableau associated to the branching in (15. 2p . 

1 1 1 1 1 2 2 3 4 

2 3 3 3 

3 4 4 4 
4. 
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Corollary 2. The number p m ^ p of rectangular gapless shapes with p 
rows and m columns is equal to, 

P fm+2i-l\ P P .... 

p = tt i * i = nn mmj 

Pm,p 11 , 2 i-l\ 1111 i + 

i=l \ i I i=l j=i J 

Proof. The number of such rectangles is by the above bijections equal to 
the number of semi-standard Young tableaux with entries in 1, 2, ... ,p 
and having less than m+1 columns, which is also the number of column- 
strict partitions (see |Sta71j ). □ 

5.1. Decomposition of a triangular gapless shape. For any inte- 
ger k < n triangular gapless shape of size n can be decomposed into a 
rectangle with k rows (and n — k columns) and two triangles of sizes k 
and n — k as shown in Figure [2J 




Figure 2. Decomposition of a gapless triangle 



From this decompostion we get the following asymptotic estimate on 
the number of gapless triangular shapes. 

Proposition 5. The number a n of gapless triangular shapes of size n 
satisfies the inequality: 

^ Pn—k,k^n—k 

where p m ^ denotes the number of rectangular gapless shapes with k 
rows and m columns. 
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Proof. Given a rectangular gapless shape R with k rows and n — k 
columns, we build a triangular gapless shape T adding above any tri- 
angular shape Ti and on its right a triangular shape T 2 in which all 
entries are equal to 1. □ 

A lower bound for an asymptotic evaluation purpose may be obtained 
when taking k — | . 

Corollary 3. Consider the sequence of integers given by 
a.\ — 1, ch.2 — 2, a 3 = 6, «4 = 26 

and 

a n = Pfsusjarsi- 
Then the number of gapless shapes of size n is greater than a n . 



However, numerics suggest that the true estimate is 
(5.3) a n ~ 



2 12 

It would be interesting to derive this from a formula for a n . 

6. Magog Triangles 

We now prove a bijection between Magog triangles (repesenting to- 
tally symmetric self-complementary plane partitions) which avoid a 
certain pattern and 312 avoiding Gog words. 

Definition 5. A Magog triangle or fundamental domain for partitions 

of size n is an array (%) of positive integers defined for n > i > j > 1 
that is written in the form 



(6.1) 



b 



2,1 "2,2 



b n ,l b n> 2 ■ ■ ■ fr n ,n> 



where, 

(1) b id < n, 

(2) bij < b i+ ij and bij < whenever both sides are defined 
(weak decreasing along both directions), 

(3) b itj >i. 

Definition 6. A Magog triangle b contains a gap at position if 
— > 1. A gapless Magog triangle is a Magog triangle which 
contains no gaps. 
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Notice that the above condition is very similar to that defining gap- 
less monotone triangles in Definition [2J We showed in Section M that 
Gog words which avoid the generalized 312 pattern are in bijection 
with gapless monotone triangles, but we have not been able to find 
an interpretation for gapless Magog triangles. Since Magog triangles 
were motivated by and are in bijection with totally symmetric self- 
complementary plane partitions, one could hope for a natural interpre- 
tation in that context. 

Consider the following transformation A associating to any mono- 
tone triangle (a y -) with integer coefficients a new triangle (a^) given 
by 

Kj = a i,j +i-J 

Theorem 4. For a monotone triangle T = (ay) the triangle A(T) is 
a Mogog triangle if and only if T is gapless. Furthermore, A(T) is a 
gapless Magog triangle. 

Proof. The proof is straightforward and left to the reader. □ 

We give an example to illustrate the idea. The gapless monotone 
triangle, 

2 

(6.2) \ \ 4 

1 2 3 4, 



maps to the gapless Magog triangle 
(6.3) 



2 

3 3 

3 3 4 

4 4 4 4. 



Notice that whenever the difference between the entries at positions 
(i,j) and (i + l,j) in the gapless monotone triangle was 5 (5 = 0, 1 by 
definition), the difference between the entries at positions (i + and 
in the Magog triangle was 1—5. This is an obvious consequence 
of the bijection. 



7. 312 PATTERNS FOR PERMUTATIONS 

We will now show a permutation avoids the pattern 312 if and only 
if the some monotone triangle associated to it is gapless. First, we 
remind the reader of the definition of pattern avoidance for the specific 
case of the pattern 312. 
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Definition 7. A permutation it of the letters {1, . . . ,n} contains the 
pattern 312 if there exists positive integers i,j,k, with 1 < i < j < 
k < n such that 7Tj > 7r^ > 7ij . If no such triple of integers exist, the 
permutation ir is said to avoid the pattern 312. 

Before we demonstrate the bijection, we need a simple but useful 
observation. 

Remark 2. If a permutation tc contains the pattern 312 at positions 
(i,j,k) and j — i > 1, then there exists another integer I, % < I < j 
such that the permutation contains another pattern 312 at (I, I + 1, k). 
The proof of this comes by looking at the integer 7r ;+1 . // 7r i+1 < 
then (i, % + 1, k) is the required triple. If not, then (i + 1, j, k) is the new 
triple and we iterate. 

For example, the permutation 7r = 542163 has a 312 pattern as 
shown. The iteration is as follows, 



We use the above observation to refine the definition of containment of 
the 312 pattern. 

Definition 8. We say that a permutation ir contains the 312 pattern 
at position i if it contains a 312 pattern at positions (i,i + l,k) for 
some k > i + 1. 

Remark |2] leads to the following proposition. 

Lemma 1. Assuming that a permutation n = (tti, . . . , 7r n ) does not 
contain a 312 pattern at any positions less than i, it avoids the 312 
pattern at position i if and only if the set Si = {iTj\j < i + 1, itj > ^i+i} 
consists of consecutive integers. 

Proof. Suppose there are no 312 patterns at positions less than i. The 
only way to get a 312 pattern at position i is to have n,i > 7r i+ i + 1 
and have a k such that if 7Tj + i < 7ik < Hi, then k > i + 1. But if Si is 
consecutive, all such /c's will necessarily satisfy k < i. 

For the converse, assume that Si is not consecutive. Therefore, there 
exists a smallest k such that -n^ > 7c i+1 and tt^ ^ Si. Now, if Hi < 71^, 
then is not consecutive either, which is a contradiction. 

Therefore, we must have 7Tj > 7tk, in which case {^i^i+i^k) is the 
required 312 pattern. □ 

As a consequence of Lemma [lj we need to only look at the prefix of a 
permutation {iTj\j < i + 7Tj > 7Tj + i} to see if it contains a 312 pattern. 
Of course, to ensure that the permutation avoids 312, we must look at 
the entire permutation. 




542163 ->■ 542163 -> 542163. 
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Lemma 2. A permutation n on n letters contains the pattern 312 at 
position i ( assuming no 312 pattern at positions less than i) if and only 
if there exists a gap in the corresponding monotone triangle a at row i. 

Proof. Consider rows i, i + 1 for the monotone triangle a. Suppose 
= 7Tj+i and look at columns starting j because the columns from 
1 to j — 1 will be unchanged. Since 7Tj + i is the only new entry in row 
i + 1, all the entries in row i larger than it will be shifted to the right 
by one in column i + 1 as shown, 

diJ+X ■ ■ ■ @>i,i 

\ 

a i+l,j+l ■ ■ ■ • • • a i+X,i+X- 

Notice that the set {oj+ij, . . . , dj+i^+i} equals S{. As a consequence of 
Lemma [TJ it is clear that there will be no gaps if and only if this set is 
consecutive. 

□ 

Remark 3. If a permutation contains the pattern 312 at position i, 
then there could be multiple columns where the gap occurs at row i. For 
example, the permutation 3 514 2 contains a 312 at the second position 
but the monotone triangle 

3 

3 5 

(7.3) 1 3 5 

13 4 5 
1 2 3 4 5, 

contains two gaps in the second row. 

8. Gog words 

We now define words which are enumerated by the ASM numbers 
and are in natural bijection with alternating sign matrices. Before that, 
we need an alphabet, the set of which itself depends on n. 

Definition 9. The Gog alphabet, A, is given by tuples (pi, ?i, • • • , 
Pk-liQk-iiPk) such that each 1 < p x < q x . ..p k -i < qk-x < Pk- 

For example, A contains all the integers but in addition contains 
elements such as (1, 2, 3) and (7, 9, 10, 13, 17). In all examples, we will 
avoid commas between the entries in a tuple throughout the article. 

Definition 10. A Gog word w of size n is a word consisting of elements 
of A satisfying the following conditions: 



(7.2) 



*h3 



\ 



a i+X, 
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(1) The length of the word is n, 

(2) Each letter in the word has maximum entry at most n, 

(3) An integer in an even numbered position in a tuple is repeated 
in another tuple to its left and to its right in odd numbered 
positions, 

(4) Every repeated integer alternates in odd and even numbered po- 
sitions in subsequent tuples. 

Notice that the first and last letter has to be of size one. Clearly, 
Gog words with alphabets of size one correspond to permutations. We 
omit the brackets around singleton elements (i.e., we write 2 instead 
of (2)) for ease of reading. For example 2(123)2 and 213 are both Gog 
words of size 3 and 25(12456) (345) (234)3 is a Gog word of size n — 6. 

A word about notation. We will denote elements of the alphabet A, 
also called tuples, by Xi, the lengths of these elements by 2ki — 1, odd 
elements of these tuples by pj and even elements by qj. Elements of 
the monotone triangle will be denoted using the same subscripts, e.g. 

a i ,j ■ 

Remark 4. There is a natural bijection relating Gog words and al- 
ternating sign matrices. The jth tuple of a Gog word is simply the 
positions, in increasing order, of nonzero entries in the jth row in the 
corresponding alternating sign matrix. The even numbered positions 
correpond to -1 and the odd numbered ones, to +1. 

Remark 5. There is a natural bijection relating Gog words and mono- 
tone triangles. Given a Gog word X\ . . . x n , the first row of the cor- 
responding monotone triangle is simply the first element and the ith 
row is obtained by taking the i — 1th row, removing the even-positioned 
elements in X; L from it, appending the odd-positioned elements in Xi to 
it, and sorting in increasing order. 

Given a monotone triangle a, the first tuple is the singleton element 
in the first row, and the ith tuple in the corresponding Gog word is 
given by listing the sequence 

(8-1) ( a i,l, a i-l,l, ■ ■ ■ , 0>i,i-l, 0>i-l,i-l, 0>i,i) 

and removing occurences of every repeated integer. 
For an example, consider the monotone triangle, 

3 

1 3 
1 2 4 
1 2 3 4. 



(8.2) 
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We construct first the lists of sequences (3)(133)(11234)(1122344) and 
then remove every occurence of repeated integers to get (3) (1) (234) (3). 
Both the bijections in Remark [4] and Remark [5] are commensurate 
with the well-known bijection relating monotone triangles and ASMs 
|MRR83j . 

Notice that a Gog word is not a permutation of letters in the alphabet 
A, as the example 2(123)2 shows. 

9. 312 SUBPATTERNS FOR GOG WORDS 

We showed in Lemma[2]that a 312 pattern in a permutation is equiv- 
alent to a column-wise difference greater than one in the corresponding 
monotone triangle. A natural generalization would be to interpret the 
occurence of this columnwise difference in an arbitrary monotone trian- 
gle as the occurence of a generalized 312 pattern in the corresponding 
Gog words. 

For example, the monotone triangle in f)8.2p corresponds to the word 
31(234)3 and the fact that the (1, l)th entry minus the (l,2)th entry 
is greater than one can be interpreted as an occurence of a generalized 
312 pattern. We now make this notion precise. 

Definition 11. We say that an integer m is active with respect to a 
tuple x = (p u qi,..., Pk-i,qk-hPk) if m > p k or if pj < m < qj for 

je[k-l\. 

Definition 12. We say that integers c, a, b form a 312-subpattern of 
the Gog word w = X\X 2 ■ ■ ■ x n if the following conditions hold 

(1) c, a, b appear in odd positions in Xi, Xj,x k respectively where i < 
J < k, 

(2) b is not in an even position in x i+ i, . . . , x k ~i, 

(3) b is active with respect to xj. 

(4) a <b < c. 

In the above example (18.21) . 3_1 (234)3 contains the 312-subpattern. 
The following two examples illustrate the subtlety of the activity con- 
dition. 

25(12356)542 
contains a 312-subpattern but 

25(12456)532 

does not. 

This definition is stronger than the one used in |JL07] , whose condi- 
tions, in this language, amount to (1) and (4) in Definition [12j There- 
fore, the number of Gog words avoiding the 312-subpattern is bounded 
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below by the number of alternating sign matrices avoiding the permu- 
tation matrix of the permutation 312. 

Remark 6. If a Gog word w = xi . . . x n contains the 312-subpattern 
(c,a,b) at positions Xi,Xj,Xk whose lengths are 2pi — l,2pj — 1 and 
2pk — 1 respectively, then ((2^)2^-1, ( x j)ii b) is also a 312-subpattern 
since (2^)2^-1 > c and (xj)i < a. Notice that the activity condition is 
unaffected. 

A natural question would be whether Remark [2] generalizes to Gog 
words. The following lemma shows that it does. 

Lemma 3. If a Gog word w = x\ . . . x n contains the 312-subpattern, 
then there exist positions i, k such that the subpattern (c, a, b) appears 
%n x%^ x^-j-i, Xf» • 

Proof. The idea of the proof is very similar to that in Remark [2j Sup- 
pose that the 312-subpattern in w occurs at Xi,Xj,Xk respectively. It 
follows from Remark [6] that we can take c = {xi)2 Pi -i and a = (xj)\. 
Now look at the last entry in x i+ i, p = (xi + i) 2pi+1 -i- 

First, note that p cannot be equal to b because b is present in an 
odd position in x^ and therefore, that would force b to be in an even 
position between Xi + i and which is forbidden in the definition of 
the 312-subpattern. 

If p > b, then (p, a, b) is a 312-subpattern and we iterate. If p < b, 
then (c, p, b) is a possible 312-subpattern if we can show that b is active 
with respect to Xi+i. But this is guaranteed since b is larger than p, 
which is the largest element in Xi + \. This proves the lemma. □ 

We will now generalize Lemma [1] from permutations to Gog words. 

Lemma 4. Let w = x\ . . . x n be a Gog word and a be the corresponding 
monotone triangle. Let = (pi,q%, ■ ■ ■ ,pk-i,qk-i,Pk)- Define 

Pi = {a>i,j\qi > ciij > Pi}, for I < k and 
Pk = { a i,j\ a i,j >Pk}- 

Then there is no gap at row i in a if and only if Pi U {p{\ for I < [k] 
and Pk consist of consecutive integers. 

Proof. We begin with an innocuous observation. Let w = x% . . . x n be 
a Gog word of size n and a be the corresponding monotone triangle. 
Let xj = (pi,qi, ■ • • ,Pk-i,Qk-i,Pk)- For any i, if p { = a^qt = a;_i, s 
and p i+ i = a^t, then r < s < t. 
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This is simply a consequence of the definition of a monotone triangle. 
Suppose s < r, and part of the monotone triangle looks like 

Q>i— l,s • • • di— l,r— 1 Oi— l,r 

(9.2) m 

• • • (^i,r— 1 ^ i,r 
Pi 

Then t& < aj_i >r _i < Pi, which is a contradiction. Similarly, suppose 
t < s, from which part of the monotone triangle looks like 

a>i-i,t ■ ■ ■ 

(9-3) 

a>i,t 
Pi+i 

which implied Pi + i < a»_i t < which is again a contradiction. 

From this it follows that the set of elements {a.j_ij|r < j 1 < s} is 
exactly the same as the set Pi, 

a i—l,r a i-l,r+l ■ ■ ■ a i-l,s-l Qi 

(9.4) \ \ 

Pi Qj,r+1 • • • Q>i,s—1 ^i,s 

because none of the elements in Pj is removed. It is now clear that if 
the elements in Pi are consecutive, then there cannot be a gap between 
columns r and s. This argument works for all i < k. For i = k, the 
argument is identical to that in the proof of Lemma [21 □ 

We are now in a position to generalize Lemma [2] to Gog words. 

Theorem 5. Assuming that a Gog word w of size n does not con- 
tain the 312-subpattern at positions less than i, it contains the 312- 
subpattern at position i if and only if there exists a gap in the corre- 
sponding monotone triangle a at row i. 

Proof. Combining what we have already shown, it remains to show, 
using the notation of Lemma H] that the existence of a 312 pattern of 
row i is equivalent to the existence of a Pi which is not consecutive. 

Suppose the 312-subpattern is obtained by the triple of integers 
(c, a, b). We first show that b cannot be any of the pi's or qi's. Clearly 
b cannot be equal to any q\ because then it is in an even position in 
Xi + i, which is forbidden by definition, b cannot also be equal to any 
pi because it will be forced to be in an even position strictly between 
Xi + i and Xk as a consequence of being a Gog word, which is forbidden 
for the same reason. 
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If pk > b, Pk is not consecutive and we are done. Otherwise, by the 
activity condition, there exists I such that pi < b < qi and then Pi is 
not consecutive. As a consequence of Lemma HJ we have a gap at row 
i. 

For the converse, suppose there is a gap at row i. By Lemma HJ 
either Pi for / < k or Pk is not consecutive. In either case, there exists 
an integer x in row i and an integer z in row i + 1 in the same column 
as x such that x — z > 1. Choose an integer b such that x < b < z. 
By choice, b is active with respect to x i+ \. Let x m be the first tuple 
in which b appears in an odd position after Xi + \. By construction, b is 
not in an even position in tuples between x i+ \ and x m . We set a = p x 
and c to be the largest integer in Xi. Clearly a < b as a < x. 

All that remains to be done is to prove b < c. We will show that 
by demonstrating that the column in which c belongs cannot be to the 
left of that of x and z. If that happens, rows i — 1, i and i + 1 will look 
as follows, 

* ... x * 

(9.5) c . . . z x 

* ... * z . . . , 

and as shown, there will be a gap between rows i — 1 and i by the same 
x and which is forbidden by assumption. Therefore c cannot be in a 
column to the left of that of x and z. It can, of course, be in the same 
column (i.e. x = c), or to the right. In both cases b < c and thus, 
(c, a, b) is the required 312 pattern. □ 

10. Conclusions 

We have defined a new set of words on an infinite alphabet which are 
equinumerous with alternating sign matrices. Further, we showed that 
there is a notion of 312-avoidance which has a natural interpretation in 
terms of both monotone triangles (columnwise difference less than two) 
and in terms of ASMs (natural bijection with TSSCPPs). However, a 
number of questions remain unanswered. 

First, we would like to understand better how the number of mono- 
tone triangles in bijection with the subset of magogs grows with the 
size. We have shown that ASMs grow superexponentially in size (IB.7j) 
(see also |BF06] k with entropy Ai w 1.29904 f lBT8|) . We have been able 
to show that the number of ASMs in bijection grow like flA. 17|) . with 
entropy A2 ~ 1.13975 (IB.9p . For some strange reason, we find that 

Ai = \\. What we conjecture is that the entropy is actually, using 

39/8 

O, given by « 1.21679. 



MONOTONE TRIANGLES AND 312 PATTERN AVOIDANCE 



19 



Secondly, we observe that we do not know if there is a meaningful 
interpretation of this bijection on the TSSCPP side. If one believes that 
this bijection is not artificial, then one would expect some structure on 
TSSCPPs. We have not been able to find this structure so far. 

Finally, one would be interested in exploiting other pattern avoid- 
ances on Gog words. The definition of 312-subpatterns uses a notion of 
activity that seems somehow specific to the subpattern 312. One would 
like a more holistic definition, which encompasses other subpatterns. 



We thanks P. Duchon, O. Guibert and X. Viennot for discussions, 
Florent Le Gac for collaborating on some of the results in Section [51 
and J. Propp for informing us about the work of H. Canary. 

Appendix A. Gapless monotone triangles 

A lower bound for the number of gapless monotone triangles is given 
by the sequence a n defined by: 

(A.l) a\ = 1, a 2 = 2, a 3 = 6, a 4 = 26, a n = PffUf J a Tf 1 > 

where p m)P is the number of rectangular gapless shapes with p rows and 
m columns given by 



In order to determine the asymptotic behaviour of a n it is convenient 
to start with the formula giving p2n,2n which is 
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(A.2) 




(A.3) 




Separating the case i = 2j from i = 2j — 1 we get: 



(A.4) 
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Taking the logarithms we have: 

iog(p 2 „, 2 „) = Yl j lo ^ 2n + 2 ^ - j h ^ 

l<j<n l<i<" 

(A.5) + Yl ( lo §( 2n + 2 -? ~ X ) + lo ^ 6n ~ 2 ^ + l °g( Qn - 2 J + !)) 

l<j<n 

- j (M2j - !) + M 4 ™ - 2 3) + M 4 ™ - 2 -? + !)) • 

l<i<" 

Let /(x) be the function 

/(x) = x (log(2n + 2x) + log(2n + 2x - 1) + log(6n - 2x) 
(A.6) + log(6n - 2x + 1)) - x (log(2x) + log(2:r - 1) 

+ log(4n - 2x) + log(4n - 2x + 1)) , 

which relates to p 2 „ i2 „ by the formula 

n 

(A.7) log(p 2n , 2n ) = ^/0')-nlog(2) = S n -nlog(2) 

The next step consists in approximating the sum S n = Y^j=i /(*) usm g 
the Euler-Maclaurin formula, 



(A.8) S n = /(1) + /(n) + 4 + E f W - > 

k=2 



where /„ is the integral 
(A.9) I n = I f(x)dx 



and Bk are the Bernoulli numbers (B\ = —1/2, B 2 = 1/6, B 3 = 0, 
B A = -1/30, •••)• 

We can evaluate J„ using the formula: 
iA.10) 

/x^ for 6^ 
a; log(ax + 5)<ir = — log(ax + b) - — log(ax + 6), 
Zi 4r Zi(X Zi(X 

giving 

(A.ll) I n = A(n)n 2 + B(n)n + C(n), 
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where 
(A.12) 

9 

A(n) = -4 log(2) - 3 log(n) + - log(6n - 1) - 4 log(4n + 1) 

9 

- 2 log(4n - 1) + - log(3n - 1) 

+ 2 log(2n + 1) - h - log(2n - 1) + - log(n + 1), 

3 3 11 

B{n) = - log(6n - 1) log(4n + 1) log(4n - 1) + - log(2n + 1). 

2 2 2 2 

C (n) = ~ log(6n - 1) - ^ log(4n + 1) + ^ log(4n - 1) 

- X - log(3n log(2n + 1) + | log(2n - 1) - X - log(n + 1). 
Using the approximation formula 

b b 2 

(A.13) log(an + 6) = log(a) + log(n) + -— ^ + 0(l/n 3 ), 

an 2a z n z 

we obtain the following approximations when n — > oo 
(A.14) 

I n + /(1) t /(n) " «log(2)) = n 2 (91og(3) - 121og(2)) 



+ n(| log(3) - log(2)) + I log(n) + 0(1), 



giving 



§(fH-r(l)) = -^og(n) + 0(l), 

7 (3) (i)-/ (3) (o) = o(i), 



log(p 2 n,2n) =n 2 (91og(3) - 121og(2)) 



(A 15) + <\ log(3) - log(2)) - 1 tog(n) + 0(1), 

^^J^ 1/24 (l + 0(l/log(n))), 
where 7 is a constant. Hence 

/ o9n 2 +3n \ ^ 4 

Pn,n = 7 2" 1 / 24 ^(l + Oa/log^)) 
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Since we have 

(A.16) a n = P„/2,n/2«n/2, 

we obtain: 

(A.17) «» = / 3 (^) ™- 1/24 (l + 0(l/log(n))) 

where /3 is a constant. 

Appendix B. Alternating signs matrices 

Bleher and Fokin [BF06] have already given an asymptotic estimate 
of the number u n of ASMs using Riemann-Hilbert methods. For com- 
pleteness, we give an estimate using more elementary techniques. Re- 
call that 

(3i + l)! 



(B.l) u n = j [ 



0<i<n v ' 

We proceed as above taking the logarithms, 

log(u n ) = ( n - i) ( lQ g( 3z - l ) + lo s( 3z ) + lQ g( 3z + l )) 

(B.2) ^ 

— y, (nlog(i + 1) + (n — i) log(n + if) . 

l<i<n 

Then we consider the function: 

f(x) = (n-x) (log(3ar - 1) + log(3x) 

+ log(3x + 1) — log(n + x)) — n log(x + 1), 

and the integral 

/n— 1 
f(x)dx. 

This time we get 
(B.4) 

In = ~ (1 - n) log(2) + i n(n - 2) log(3) - n 2 log(n) 



+ 



+ 



(3n + 2)(3n - 4) log(3n - 4) + (3n + 4)(3n - 2) log(3n - 2) 

18 

(n — l)(n + 1) log(n — 1) 



2 

+(n + l)(3n - 1) log(n + 1) - (2n - l)(2n + 1) log(2n - 1) 
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Again the Euler-Maclaurin formula gives 
(B.5) 

S n -\(f(l) + f(n-l)) = ^ + f(2)... + f(n-2) + ^ Y ^- 

oo 

= J « + E(|y!(/ (2 " 1) (-- 1 )-/ (2 " 1) ( 1 ))- 

Using log(an + b) = log(a) + log(n) + ^ - ^2 + 0(l/n 3 ), we get 



In + 2 (/(!) + /W) = 9 M") " « + - J log(2) 
+ nQn-0 log(3)+n + 0(l), 

(B.6) f (/'(-- !)-/'(!)) = -i--^og(n) + O(l), 
^(/ W (n-D -/«(D) = ^ + 0(1), 

logK) = -2n 2 log(2) + ^n 2 log(3) 

+ nlog(/3)-^log(n) + 0(l), 

which leads to 

(B.7) Mn = 7 I \ P n n~ 5 / 36 (1 + 0(1/ tog(n))) , 

where 7 and /3 are constants. Notice that the number of ASMs grows 
like (Ai) n where 

(B.8) A 1= f 27 V /2 ^ 



\1QJ 4 ' 

while we have found the lower bound (A2)" 2 for the number of those 
avoiding 312 is 

33/4 

(B.9) A 2 = — . 
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